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(§4) Orthogonal transform coding apparatus and decoding apparatus. 

@ Image signals are orthogonal-transformed (DCTed) in mutually different dimensions (DMs) to obtain 
transform coefficients (TC) for each DM, which are then compared mutually to select TC of one DM 
based on the comparison. Or else, such TC of one DM are selected based on the image signals in a 
specific DM and the selected TC are quantized and variable-length coded to output coded signals. In 
another way, prediction error (PE) signals obtained by predictive coding (PC) are DCTed in mutually 
different DMs to obtain TC for each DM ; the TC of one DM are selected based on the PE signals in a 
specific DM, and then quantized and coded. Or else, the TC obtained for each DM are quantized and 
then compared mutually. The quantized signals of one DM are selected based on the comparison and 
then coded. Or else, the TC obtained for each DM are quantized and coded, and coded signals of one 
DM are selected based on the comparison. The coded signals are transmitted together with mode 
information (Ml) indicating which DM the selected TC are transformed in. The coded signals are 
decoded, and then inversely quantized (IQed). The IQed signals are inversely DCTed in the DM indicated 
by the Ml. 
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BACKGROUND OF THE INVENTION 
Field of the Invention 

5 The present invention relates to a coding apparatus and a decoding apparatus for executing orthogonal 
transform (DCT (Discrete Cosine Transform), in particular), which can code signals and decode the coded sig- 
nals by a high efficient coding and decoding method on the basis of a small coding quantity, in a digital signal 
processing (e.g., recording, transmitting, displaying, etc.) system. 

10 Description of the Prior Art 

In the high efficient coding technique using the orthogonal transform such as DCT, the quantity of data 
can be reduced on the basis of effective utilization of interframe correlation. Therefore, this coding technique 
is widely adopted as the standard technique. In this coding technique, the orthogonal transform is executed, 

15 in general, in two dimensions of vertical and horizontal directions of a block of image signals, for instance. This 
is because in the case of the one dimensional orthogonal transform, only one of the vertical and horizontal 
interframe correlations can be used; on the other hand, in the case of the two dimensional orthogonal trans- 
form, both the vertical and horizontal interframe correlations can be used. 

Further, it is effective to increase the size of transform block from the correlation standpoint, because the 

20 interframe correlation can be utilized more efficiently with increasing size of the transform block. In practice, 
however, there exists no substantia! difference when the number of pixels is 8 x 8 or more. On the other hand, 
since the quantization error extends over the block, it is preferable to decrease the size of the block from the 
visual standpoint. In addition, the processing quantity decreases with decreasing size of the block. 

In summary, it is most general to transform image signals of the block of 8 x 8 pixels (8 degrees in both 

25 vertical and horizontal directions). In addition, in the case of the moving image coding, it is general to execute 
interframe predictive coding in the time direction and to adopt the spatial orthogonal transform for the predic- 
tion error. 

Fig. 1 shows a prior art coding apparatus. In the drawing, the apparatus comprises an image input 1, a 
horizontal DCT (discrete cosine transformer) 2, a vertical DCT 3, a quantizer 5, a variable length coder 6, and 

30 a coded signai output 7. The horizontal DCT 2 transforms inputted image signals in accordance with 8-degree 
discrete cosine transform in the horizontal direction for each two-dimensional block of 8 x 8 pixels. Further, 
the vertical DCT 3 further transforms the horizontally DCTed (discrete cosine transformed) signals in accor- 
dance with 8-degree discrete cosine transform in the vertical direction. The quantizer 5 quantizes the DCTed 
signals to such a quantization step width that the quantization error is not distinguishable visually. Here, the 

35 coefficients of almost all quantized signals are zero. The variable length coder 6 transforms the sequence of 
signals arranged in the two-dimensional block status into the sequence of signals arranged in the one-dimen- 
sional status (referred to as "zigzag scanning sequence") as listed in Fig. 2A. The run lengths of the zero coef- 
ficients and the values of the non-zero coefficients are coded in accordance with a VLC (variable length cod- 
ing) such as Huffuman code. The output of the variable length coder 6 is outputted as compressed data to a 

40 decoding apparatus (described below) through the code output 7. 

Fig. 3 shows a prior art decoding apparatus corresponding to the coding apparatus shown in Fig. 1. The 
decoding apparatus comprises a coded signal input 21 , a variable length decoder 22, an inverse quantizer 23, 
a vertical inverse DCT 24, a horizontal inverse DCT 25, and an image output 26. The variable length decoder 
22 decodes the compressed data of the variable length code to the fixed length codes. The inverse quantizer 

45 23 inversely quantizes the fixed length codes to values representative of the quantization of the coded signals. 
The vertical inverse DCT 24 inversely transforms the inputted representative values in the vertical direction. 
The horizontal inverse DCT 25 further inversely transforms the inputted representative values in the horizontal 
direction. The obtained reproduced image signals are outputted through an image signal output 26. 

In the above-mentioned two-dimensional orthogonal transform coding apparatus, the transform efficiency 

so is relatively high in the image portion in which the interframe correlation is relatively high. However, the prior 
art apparatus is not necessarily suitable for the image portion in which the interframe correlation is relatively 
low, for instance at the image edge portions. The above-mentioned tendency is prominent in the interframe 
prediction error signals, in particular. In other words, since the interframe correlation of the error signals is 
low, the two-dimensional orthogonal transform is not an appropriate coding method. Therefore, there exist 

55 some portions at which the one-dimens tonal transform such as only the horizontal or vertical transform is high- 
er in efficiency than the two-dimensional transform. 

Further, in the two-dimensional transform, the quantization error extends over the two-dimensional block, 
so that the noise components are prominent in the vicinity of the image edges. In other words, the one-d'h 
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mensional transform using a small transform block is preferable from the visual standpoint as far as the equiv- 
alent coding error is allowed. Further, although the other coding technique such as DPCM (Differential Pulse 
Code Modulation) is preferable because the noise components are not prominent from the visual standpoint, 
the interframe correlation cannot be utilized effectively in the other coding technique, so that the basic effi- 
5 ciency is insufficient 

SUMMARY OF THE INVENTION 

The object of the present invention is to provide an orthogonal transform coding apparatus high in coding 
10 efficiency and low in noise components, and an orthogonal transform decoding apparatus corresponding to 
the coding apparatus. 

To achieve the above-mentioned object, the present invention provides an image signal coding apparatus 
comprising: means for orthogonal-transforming image signals to be coded in different dimensions to obtain 
transform coefficients for each mutually-different transform dimension; means for detecting a status of the im- 

15 age signals in a predetermined dimension; means for selecting the transform coefficients of one of the trans- 
form dimensions on the basis of the detected result; means for quantizing the selected transform coefficients; 
and means for coding the quantized signals to output the coded signals. 

Further the present invention provides an image signal coding apparatus comprising: means for forming 
prediction error signals by subtracting prediction signals from image signals to be coded, respectively; means 

20 for orthogonal-transforming the prediction error signals in mutually different dimensions to obtain transform 
coefficients for each different transform dimension; means for detecting a status of the prediction error signals 
in a predetermined dimension; 

means for selecting the transform coefficients of one of the dimensions on the basis of the detected result; 
means for quantizing the selected transform coefficients; and 

25 means for coding the quantized signals to output the coded signals. 

Further, the present invention provides an image signal coding apparatus comprising: means for ortho- 
gonal-transforming image signals in mutually different dimensions to obtain transform coefficients for each dif- 
ferent transform dimension; means for quantizing the transformed coefficients for each dimension; means for 
comparing the quantized signals for each dimension; means for selecting the quantized signals of one of the 

30 transform dimensions on the basis of the compared result; and means for coding the selected quantized signals 
to output the coded signals. 

Further, the present invention provides an image coding apparatus comprising: means for orthogonal- 
transforming image signals to be coded in mutually different dimensions to obtain transform coefficients for 
each different transform dimension; means for quantizing the transformed coefficients for each dimension; 

35 means for coding the quantized signals for each dimension; means for comparing a coded quantity of the coded 
signals for each dimension; and means for selecting the coded signals of one of the transform dimensions on 
the basis of the compared result 

Further, the present invention provides an image signal decoding apparatus for decoding coded image 
signals obtained by orthogonal-transforming image signals in mutually different dimensions, selecting trans- 

40 formed coefficients of one dimension from the transformed coefficients obtained in the different dimensions 
according to a status of the image signals in a predetermined dimension, quantizing the selected transformed 
coefficients, coding the quantized signals, the coded image signals being transmitted together with mode in- 
formation indicating which dimension the selected coefficients have been transformed in, which comprises: 
means for decoding the coded signals; means for inversely quantizing the decoded signals; and means for 

45 inversely orthogonal-transforming the inversely quantized signals in the dimension indicated by the mode in- 
formation to obtain reproduced image signals. 

Further, the present invention provides an image signal decoding apparatus for decoding coded image 
signals obtained by orthogonal-transforming prediction error signals obtained by predictive coding in mutually 
different dimensions, selecting transformed coefficients of one dimension from the transformed coefficients 

so obtained in the different dimensions according to a status of the prediction error signals, quantizing the se- 
lected transformed coefficients, coding the quantized signals, the coded image signals being transmitted to- 
gether with mode information indicating which dimension the selected coefficients have been transformed in, 
which comprises: means for decoding the coded signals; means for inversely quantizing the decoded signals; 
means for inversely orthogonal-transforming the inversely quantized signals in the dimension indicated by the 

55 mode information to obtain reproduced prediction error signals; and means for reproducing the image signals 
by adding already-reproduced image signals to the reproduced prediction error signals, respectively. 

Further, the present invention provides a method of coding image signals, comprising the steps of: ortho- 
gonal-transforming image signals to be coded in different dimensions to obtain transform coefficients for each 
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mutually different transform dimension; detecting a status of the image signals In a predetermined dimension; 
selecting the transform coefficients of one of the transform dimensions on the basis of the detected result; 
quantizing the selected transform coefficients; and coding the quantized signals to output the coded signals. 
Further, the present invention provides a method of coding image signals, comprising the steps of: forming 

5 prediction error signals by subtracting prediction signals from image signals to be coded, respectively; ortho- 
gonal-transforming the prediction error signals in mutually different dimensions to obtain transform coefficients 
for each different transform dimension; detecting a status of the prediction error signals in a predetermined 
dimension; selecting the transform coefficients of one of the dimensions on the basis of the detected result; 
quantizing the selected transform coefficients; and coding the quantized signals to output the coded signals. 

10 Further, the present invention provides a method of coding image signals, comprising the steps of: ortho- 
gonal-transforming image signals to be coded in mutually different dimensions to obtain transform coefficients 
for each different transform dimension; quantizing the transformed coefficients for each dimension; coding the 
quantized signals for each dimension; comparing coded quantity of coded signals for each dimension; and se- 
lecting the coded signals of one of the transform dimensions on the basis of the compared result. 

15 Further, the present invention provides a method of decoding coded image signals obtained by orthogonal- 
transforming image signals in mutually different dimensions, selecting the transformed coefficients of one di- 
mension from the transformed coefficients obtained in the different dimensions according to status of the im- 
age signals in a predetermined dimension, quantizing the selected transformed coefficients, coding the quan- 
tized signals, the coded image signals being transmitted together with mode information indicating which di- 

20 mansion the selected coefficients have been transformed in, which comprises the steps of: decoding the coded 
signals; inversely quantizing the decoded signals; and inversely orthogonal-transforming the inversely quan- 
tized signals in the dimension indicated by the mode information to obtain reproduced image signals. 

Further, the present invention provides a method of decoding coded image signals obtained by orthogonal- 
transforming prediction error signals obtained by predictive coding in mutually different dimensions, selecting 

25 the transformed coefficients of one dimension from the transformed coefficients obtained in the different di- 
mensions according to status of the prediction error signals, quantizing the selected transformed coefficients, 
coding the quantized signals, the coded image signals being transmitted together with mode information in- 
dicating which dimension the selected coefficients have been transformed in, which comprises the steps of: 
decoding coded signals; inversely quantizing the decoded signals; inversely orthogonal-transforming the in- 

30 versely quantized signals in the dimension indicated by the mode information to obtain reproduced prediction 
error signals; and reproducing the image signals by adding already- reproduced image signals to the repro- 
duced prediction error signals, respectively. 

BRIEF DESCRIPTION OF THE DRAWINGS 

35 

Fig. 1 is a block diagram showing a prior art orthogonal transform coding apparatus; 
Fig. 2A is a table showing the transform (scanning) sequence of two-dimensional arranged signals; 
Fig. 2B is a table showing the transform (scanning) sequence of one-dimensional arranged signals; 
Fig. 3 is a block diagram showing a prior art orthogonai transform decoding apparatus; 
40 Fig. 4 is a block diagram showing a first embodiment of the orthogonal transform coding apparatus ac- 
cording to the present invention: 

Fig. 5 A is a table showing the construction of a two-dimensional DCTed (discrete cosine transformed) 
block; 

Fig. 5B is a table showing the construction of a one-dimensional DCTed (discrete cosine transformed) 
45 block; 

Fig. 6 is a block diagram showing a second embodiment of the orthogonal transform coding apparatus 
according to the present invention; 

Fig. 7 is a block diagram showing a third embodiment of the orthogonal transform coding apparatus ac- 
cording to the present invention; 
so Fig. 8 is a block diagram showing a first embodiment of the orthogonal transform decoding apparatus ac- 
cording to the present invention; 

Fig. 9 is a block diagram showing a fourth embodiment of the orthogonal transform coding apparatus ac- 
cording to the present invention; 

Fig. 10 is a block diagram showing a fifth embodiment of the orthogonal transform coding apparatus ac- 
55 cording to the present invention; 

Fig. 11 is a block diagram showing a sixth embodiment of the orthogonal transform decoding apparatus 
according to the present invention; and 

Fig. 12 is a block diagram showing a second embodiment of the orthogonal transform decoding apparatus 
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according to the present invention. 
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

5 The embodiments of the coding apparatus and decoding apparatus according to the present invention will 
be described hereinbelow with reference to the attached drawings. 

Fig. 4 shows a first embodiment of the orthogonal coding apparatus. The apparatus comprises an image 
signal input 1, a horizontal DCT (discrete cosine transformer) 2, a vertical DCT 3, a selector 4, a quantizer 5, 
a variable length coder 6, a coded signal output 7, and in addition a first activity detector 8, a second activity 

w detector 9, a mode discriminator 10, and a mode output 11 

Image signals inputted through the image input 1 are DCTed (discrete cosine transformed) in the horizontal 
direction for each block of 8 x 8 pixels by the horizontal DCT 2, and then the horizontal DCTed signals are 
given to the vertical DCT 3, the selector 4, and the first activity detector 8, respectively. The horizontal DCTed 
signals are further DCTed in the vertical direction by the vertical DCT 3, and then the two-dimensional DCTed 

15 signals are given to the selector 4, and the second activity detector 9. 

Here, when the image signals are DCTed only in the horizontal direction by the horizontal DCT 2, the DCT 
block is of one-dimension (horizontal direction) of 8 pixels. However, it is convenient to bundle 8 DCT blocks 
in the vertical direction into a block of 8 x 8 pixels under consideration of switching from one-dimensional proc- 
essing to the two-dimensional processing or vice versa. 

20 Fig. 5A shows a two-dimensional DCT block; and Fig. 5B shows a horizontal DCT block. In Figs. 5A and 
5B, DCs represent average components of the DCT coefficients of the DCTed signals, and blanks represent 
alternating components (AC), respectively. 

The first activity detector 8 detects the activity of the signals DCTed only in the horizontal direction. The 
activity Aid of the signals can be obtained by an addition of absolute values of the respective DCT coefficients, 

25 for instance as expressed by formula (1 ) below: 

Aid - £ f i Cld^ | ♦ £ | CXd oy - Cid Q(rl> | (1) 

30 

where Cidxy denotes a coefficient value of the x-th DCT position in the horizontal direction and the y-th DCT 
position in the vertical direction; and Cldoy denotes a DC component 

Further, although there exist 8 DC components within a block of 8 x 8 pixels, the simple sum of these DC 
35 absolute values is not suitable for the activity. Therefore, differences between adjacent two DC components 
in the vertical direction are calculated as the formula (1) above. Further, in the formula (1), the first one DC 
value (at which no difference can be obtained) is excluded from the above-mentioned addition. 

The second activity detector 9 detects the activity of the signals two-dimensional DCTed both in the hor- 
izontal and vertical directions. The activity A2d of the signals can be obtained by an addition of absolute values 
40 of the respective coefficients, for instance as expressed by formula (2) below: 

a E E i i - u> 

45 

where C2dxy denotes a coefficient value of the x-th two-dimensional DCT position in the horizontal direction 
and the y-th two-dimensional DCT position in the vertical direction; and C2doo denotes a DC component. Fur- 
ther, in the formula (2), the one DC component is excluded. 
so Further, in the case where the coded signals are not the image signals but the error signals of the inter- 
frame prediction, since the DC component is substantially regarded as the AC component, the absolute values 
of all the coefficients are simply added. In practice, the following formula (3) is used in place of the formula 
(1 ) in the first activity detector 8, and t he fallowing formula (4) is used in place of the formula (2) in the second 
activity detector 9. 

55 
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Here, the unit of pixels switched for processing is not necessarily the same as the number of pixels of the 
is DCT block (8x8 pixels); that is, it is possible to bundle a plurality of the DCT blocks In the case where the 
color difference signals of color images are sub-sampled, in particular, since a plurality of luminance signal 
blocks and the color difference signal block are pained, the bundled blocks are sometimes convenient 

The horizontal DCT activity obtained by the first activity detector 8 and the two-dimensional DCT activity 
obtained by the second activity detector 9 are given block by block to the mode discriminator 10. 
20 The mode discriminator 10 compares the two activities to determine which one of the activities is smaller 
than the other; that is, to obtain mode information. In this comparison, it is possible to add a value (about 1 
for each coefficient) to one of the activities (as far as the inputted image signals are of 8 bits and represented 
by values from 0 to 255 and further the transform magnification of the horizontal DCT 2 and the vertical DCT 
3 is 8 1/2 , respectively) or to multiply one of the activities by about 1. 25, so that a certain offset can be given 
25 for adjustment of the selection. 

The mode information thus obtained is outputted to a decoding apparatus described later through the mode 
output 11 and further to the selector 4, the quantizer 5 and the variable length coder 6. On the basis of the 
mode information, the selector 4 selects transform (DCT) coefficients and the selected transform coefficients 
are given to the quantizer 5. 

30 When the respective DCT coefficients are quantized uniformly, the quantizer 5 executes the same proc- 
essing. When the DCT coefficients are weighted in accordance with the visual characteristics, the quantizer 
5 executes different processing according to the transform method. The weighted quantization of the DCT 
coefficients is executed on the basis of the mode information so as to obtain the two-dimensional character- 
istics in the case of the two-dimensional (in both horizontal and vertical directions) DCT and so as to obtain 

35 the one-dimensional characteristics in the case of the one-dimensional (in only the horizontal direction) DCT. 
The output of the quantizer 5 is coded by the variable length coder 6. The sequence of arrangement trans- 
form (scanning) executed by the variable length coding is different between the two-dimensional DCT and 
the one-dimensional DCT. The scanning sequence of the two-dimensional DCT is the same as with the case 
of the prior art as shown in Fig. 2A. However, the scanning sequence of the one-dimensional DCT becomes 

40 as shown in Fig. 2B. By processing 8 one-dimensional DCTed signals bundled as shown in Fig. 2B, it is possible 
to improve the efficiency of the O-run length coding with the use of the same VLC (variable length coding) 
table. The codes compressed by the variable length coder 6 are outputted to a decoding apparatus (described 
later) through the code output 7. 

In the first embodiment of the coding apparatus according to the present invention as describe above, the 

45 activity of the signals DCTed only in the horizontal direction is obtained by the first activity detector 8, and fur- 
ther the activity of the signal two-dimensional DCTed in both horizontal and vertical directions is obtained by 
the second activity detector 9. In other words, the activities of the DCTed signals are calculated on the basis 
of transform coefficients obtained by a plurality of orthogonal transforming means (the horizontal DCT 2 and 
the vertical DCT 3), and the appropriate orthogonal transforming method of the signals to be coded can be 

so discriminated or selected. Accordingly, the coding apparatus is simple in configuration and high in processing 
speed. Further, the apparatus is high in precision, as compared with the case where the activity is obtained 
by the use of the final data coded. This is because in the case of the present embodiment, the transform coef- 
ficients obtained by the horizontal DCT 2 and the vertical DCT 3 directly indicate the activity required to select 
the orthogonal transform method. 

55 Fig. 6 shows a second embodiment of the orthogonal transform coding apparatus according to the present 
invention, in which the same reference numerals have been retained for the similar parts or elements which 
have the same functions as with the case of the first embodiment shown in Fig. 4. 

In Fig. 6, the image signals inputted through the image input 1 are DCTed in the horizontal direction by 
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the horizontal OCT 2, and then given to the vertical DCT 3 and the quantizer 5. The image signals DCTed in 
the horizontal direction by the horizontal DCT 2 are further DCTed in the vertical direction by the vertical DCT 
3 as the two-dimensional DCTed signals, and then given to another quantizer 31. The horizontally DCTed im- 
age signals are quantized by the quantizers. In this case, the weighting according to the one-dimensional (hor- 

5 izontal) visual characteristics is made to the respective DCT signals or coefficients by the quantizer 5. The 
quantized coefficients are given to the activity detector 8 and the selector 4, respectively. In the same way, 
the horizontally and vertically DCTed image signals are quantized by the quantizer 31 . In this case, the weight- 
ing according to the two-dimensional (horizontal and vertical) visual characteristics is made to the respective 
DCT signals or coefficients by the quantizer 31 . The quantized coefficients are given to the activity detector 

10 9 and the selector 4, respectively. 

In Fig. 6, the functions of the activity detector 8 and the activity detector 9 are the same as with the case 
of the first embodiment as shown in Fig. 4. However, the DCTed image signals are weighted and then quantized 
in such a way that the weighting decreases as the image signal components increase in frequency. Since the 
weighting of the quantization is effected as described above, it is possible to allow the coding to be more suit- 
es able for the practical coding method. The activity of the horizontal DCTed signals obtained by the activity de- 
tector 8 and the activity of the two-dimensional DCTed signals obtained by the activity detector 9 are both 
given to the mode discriminator 1 0 for each block. 

The mode discriminator 10 compares the two activities to select the smaller one, and outputs the ortho- 
gonal transform mode information. The outputted mode information is given to the variable length coder 6 and 

20 further to a decoding apparatus (described later) through the mode output 11 . 

The selector 4 selects one of the outputs of the quantizer 5 and the quantizer 31 on the basis of the mode 
information, and the selected quantized coefficients are given to the variable length coder 6. The variable 
length coder 6 codes the quantized coefficients by changing the scanning sequence (as shown in Figs. 2A 
and 2B) on the basis of the mode information. The coded data compressed by the variable length coder 6 are 

25 outputted to the decoding apparatus through the code output 7. 

Fig. 7 shows a third embodiment of the orthogonal transform coding apparatus according to the present 
invention, in which the same reference numerals have been retained for the similar parts or elements which 
have the same functions as with the case of the first embodiment shown in Fig. 4. The basic operation of this 
third embodiment is the same as the case of the first embodiment shown, except the method of weighting the 

30 coefficients when the activities are obtained. 

In Fig. 7, the horizontal DCT 2 and the vertical DCT 3 operate in the same way as those shown in Fig. 4. 
The output of the horizontal DCT 2 is given to the vertical DCT 3 and a coefficient weighting section 42, and 
the output of the vertical DCT 3 is given to a coefficient weighing section 41 . 

The coefficient weighting section 41 divides each coefficient by a value corresponding to the weight de- 

35 termined when the two-dimensional DCTed signals are quantized. In the same way, the coefficient weighting 
section 42 divides each coefficient by a value corresponding to the weight determined when the horizontally 
DCTed signals are quantized. That is, the processing is equivalent to that by which the DCTed signals are quan- 
tized on the basis of suff icientiy small quantization step. The divided coefficient output of the coefficient weight- 
ing section 41 is given to the activity detector 9, and the divided coefficient output of the coefficient weighting 

40 section 42 is given to the activity detector 8, respectively. 

In comparison with the second embodiment shown in Fig. 6, In this third embodiment, it is possible to apply 
a weight even a small coefficient value so as to be used for the mode discrimination, otherwise it will be ne- 
glected. 

The functions of the activity detectors 8 and 9, the mode discriminator 10, the selector 4, the quantizer 5, 
45 and the variable length coder 6 are all the same as with the case of the first embodiment shown in Fig. 4. The 
compressed coded data are outputted to the decoding apparatus through the code output 7. 

Fig. 8 shows a first embodiment of the orthogonal transform decoding apparatus according to the present 
invention, in which the same reference numerals have been retained for the similar parts or selections which 
have the same functions as with the case of the prior art decoding apparatus as shown in Fig. 3. In Fig. 8, the 
50 decoding apparatus comprises a mode input 28 and a selector 27 in addition to the elements shown in Fig. 3. 
The compressed data applied through the code input 21 are introduced into the variable length decoder 22. 
On the other hand, the mode information obtained by the coding apparatus according to the present invention 
is inputted through the mode input 28, and then given to the variable length decoder 22, the inverse quantizer 
23, and the selector 27, respectively. 
55 The functions of the variable length decoder 22 and the inverse quantizer 23 are basically the same as 
those of the prior art decoding apparatus shown in Fig. 3. However, in the variable length decoder 22, the 
scanning order is switched on the basis of the mode information. Further, in the inverse quantizer 23, the 
weighting of the coefficient is switched on the basis of the mode information. The output of the inverse quan- 
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tizer 23 is given to the vertical Inverse DCT 24 and the selector 25. The vertical inverse DCT 24 inversely trans- 
forms the DCTed signals in the vertical direction. The selector 25 controlled on the basis of the mode infor- 
mation selects the output of the vertical inverse DCT 24 in the case of the two-dimensional DCTed block and 
output of the inverse quantizer 24 in the case of the horizontal DCTed block. The selected DCTed block is in- 

5 troduced to the horizontal inverse DCT 25 to inversely transform the DCTed signals in the horizontal direction. 
As described above, the two-dimensional block is inversely DCTed in both vertical and horizontal direc- 
tions, and the one-dimensional (horizontal) block is inversely DCTed in only the horizontal direction. The re- 
produced image signals thus obtained are outputted through the image output 26. 

In the orthogonal coding apparatus according to the present invention as shown in Figs. 4, 6 and 7, since 

10 the dimension of the orthogonal transform is controllably changed for each block to select an optimum trans- 
form method, it is possible to execute the optimum coding processing for each block (for each image position) 
and thereby to improve the coding efficiency all over t he image, as compared with the apparatus which adopts 
only a single transform method. Further, since the one-dimensional transform is executed at image edges, 
for instance, it is possible to reduce the quantization noise and error, thus improving the image quality. In ad- 

15 dition, the transform method is determined orselected on the basis of the activities derived from the orthogonal 
transformed coefficients or the transformed and quantized coefficients, the activities can be detected easily 
at high precision. 

Fig. 9 shows a fourth embodiment of the orthogonal transform coding apparatus according to the present 
invention, in which the same reference numerals have been retained in the same way as in the previous em- 
20 bodiments. 

In Fig. 9, the image signals given through the image input 1 are DCTed for each block of 8 x 8 pixels in 
the horizontal direction by the horizontal DCT 2, and then given to the vertical DCT 3 and the quantizer 80. 
The horizontally DCTed signals are further DCTed in the vertical direction by the vertical DCT 3, and then given 
to the quantizer 5 as the two dimensional DCTed signals. In other words, the quantizer 80 quantizes the signals 
25 DCTed only in the horizontal direction, and the quantizer 5 quantizes the signals DCTed both in the horizontal 
and vertical directions. 

Here, in the case of the horizontal transform, the DCT block is of 8 pixels of one dimension. However, as 
well as in the case of the horizontal and vertical (two-dimensional) transform, the DCT block is of 8 x 8 pixels 
of two dimension (8 horizontal blocks are bundled in the vertical direction as shown in Fig. 5B) for convenience 

30 of switching between one dimensional processing and two dimensional processing. 

When the two quantizers 5 and 80 quantize the respective coefficients of the DCTed signals uniformly, 
the quantization processing becomes the same for both. However, when the weighting is made to the respec- 
tive DCT coefficients according to the visual characteristics (e.g., rough at higherfrequencies), the quantization 
processing is different form each other. The quantizer 5 effects the quantization weighting in accordance with 

35 the two-dimensional characteristics; however, the quantizer 80 effects the quantization weighting repeatedly 
in accordance with the one-dimensional characteristics. 

The output of the quantizer 5 is coded by the variable length coder 6, and the output of the quantizer 80 
is coded by the variable length coder 90, respectively. Both the coded signals are given to the selector 4 and 
a minimum value discriminator 100. The way of arrangement transform (scanning sequence) of the variable 

40 length coding is different between the quantizers 6 and 90. In more detail, the arrangement transform in the 
variable length coder 6 is of oblique zigzag scanning as shown in Fig. 2A in the same way as in the conventional 
way, and the arrangement transform in the variable length coder 90 is of vertical scanning as shown in Fig. 
2B. This arrangement transform method is the same as disclosed in the prior application of a co-inventor and 
the same Applicant (Japanese Patent Application No. 1-213939). 

45 As described above, since the one-dimensional DCTed signals are processed for each block of 8 x 8 pixels 
by bundling the 8 pixels of one dimension so as to be processed in the same way as with the case of the two- 
dimensional DCTed signals, it is possible to improve the efficiency of the O-run length coding. Further, in this 
case, the same VLC (variable length coding) table can be used for both the quantizers 6 and 10. However, 
when two different VLC tables are used for the two quantizers appropriately, it is possible to further improve 

so the coding efficiency. 

The minimum value discriminator 100 compares the outputs of (i.e., the code quantities (the numbers of 
bits) of the respective blocks) of the two variable length coders 6 and 90, and outputs a control signal as the 
mode information so that the output of the smaller number of bits can be selected. 

Here, the unit of pixels compared with respect to the numbers of bits to switch the processing is not nec- 

55 essarily the same as the number of pixels of the DCT block (8x8 pixels); that is, it is possible to bundle any 
number of the DCT blocks. In the case where the color difference signals of color images are sub-sampled in 
particular, since a plurality of luminance signal blocks and one color difference signal block are paired according 
to the proportion of the sub-sampling, it is convenient to compare the numbers of bits for each pair to switch 
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the processing. 

The mode information is outputted to the selector 4 and further to the decoding apparatus (described later) 
through the mode output 11. The selector 4 selects one (smaller in data quantity) of the outputs of the variable 
length coders 6 and 90 and outputs the selected data through the data (code) output 7. Therefore, in the case 

5 where the correlation is small in the vertical direction, since the one-dimensional (horizontal) DCTed signals 
are selected without DCTmg the image signals in the two-dimensional, it is possible to execute orthogonal 
transform coding high at efficiency and low in noise. 

In the above-mentioned processing, when the quantization weighting is determined in such a way that the 
distortion caused by the quantization becomes the same in the respective transform processing and further 

10 one (smaller in data quantity) of the outputs of the variable length coders 6 and 90 can be selected under these 
conditions, it is possible to equalize the distortion degree and further to reduce the overall data quantity. In 
this case, when the quantization of the quantizer 80 is determined to be slightly rough, although the one-di- 
mensional transformed signals are apt to be selected and thereby the coding error increases slightly, it is pos- 
sible to obtain a coding desirable from the visual standpoint 

15 Fig. 1 0 shows a fifth embodiment of the orthogonal transform coding apparatus according to the present 
invention, in which the transform mode is determined by means different from the main coding system of the 
fourth embodiment shown in Fig. 9. 

In Fig. 10, the image signals given through the image input 1 are DCTed in the horizontal direction as block 
signals of 8 x 8 pixels by the horizontal DCT 2, and then introduced to the vertical DCT 3 and the selector 4. 

20 The horizontally DCTed signals are further DCTed in the vertical direction, and then the two-dimensional 
DCTed signals are given to the selector 4. 

On the other hand, a mode discriminating section 340 includes a vertical change detector 310, an activity 
detector 320 and a mode discriminator 330. The image signals Inputted through the image input 1 are given 
to the vertical change detector 310 for detecting the change rate v in the vertical direction, and the activity 

25 detector 320 for detecting the dispersion value d in the image block. The change rate v in the vertical direction 
and the dispersion value d of the block are expressed by the formulae as follows: 



30 



35 



40 



x»0 yC 



where dc denotes an average value, and denotes a horizontal x-th and vertical y-th pixel value in the 8 x 
8 block. 

45 The mode discriminator 330 compares the two information values. When the change rate v in the vertical 
direction is relatively large with respect to the dispersion value d, the mode discriminator 330 outputs a control 
signal to select only the horizontal DCTed signals. This is because when the signals (whose change rate v in 
the vertical direction is large) is DCTed in the vertical direction, the components of higher frequencies increase 
and therefore the transform efficiency is deteriorated as compared with when not DCTed. In other words, when 

so the mode discriminating section 340 discriminates that the change rate v of the two dimensional DCTed signals 
are relatively large, the orthogonal transform is not executed in the two-dimension to prevent the transform 
efficiency from being reduced. 

The functions of the quantizer 5 and the variable length coder 6 are the same as with the case of the first 
embodiment shown in Fig. 4. 

55 In this fifth embodiment, since only one main coding system is used, it is possible to reduce the processing 
quantity as compared with the fourth embodiment shown in Fig. 9. 

Fig. 11 shows a sixth embodiment of the orthogonal transform coding apparatus according to the present 
invention, in which the same reference numerals have been retained in the same way as in the other embodi- 
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merits. In this embodiment, interframe prediction is effected, and the orthogonal transform is effected for the 
prediction error signals. 

The image signals inputted through the image input 1 are given to a prediction subtracter 410. The pre- 
diction signals given by a frame memory 420 are subtracted from the image signals to obtain the prediction 
5 error signals. The prediction error signals are given to the horizontal DCT2 and the mode discrimination section 
340. 

The functions of the mode discrimination section 340, the horizontal DCT 2, the vertical DCT 3, the selector 
4, the quantizer 5, and the variable length coder 6 are the same as with the case of the fifth embodiment 
shown in Fig. 10. Further, the functions of a local decoding section composed of the inverse quantizer 23, the 

10 horizontal inverse DCT 25, the vertical inverse DCT 24 and the selector 27 are the same as with the case of 
the first embodiment of the decoding apparatus shown in Fig. 8. 

The prediction signals given by the frame memory 420 are added to the prediction error signals (locally 
decoded by the horizontal inverse DCT 25) by an adder 430 to obtain the reproduced image signals. The ob- 
tained image signals are given to the frame memory 420. The reproduced image signals delayed by one frame 

15 are applied as the prediction signals from the frame memory 420 to the prediction subtracter 41 0 and the adder 
430. 

The prediction error signals are lower in correlation than the ordinary image signals. Therefore, the pro- 
portion at which the one-dimensional DCTed signals are used is more increased than the ordinary image sig- 
nals. In other words, when the image moves slightly, since the prediction error is small and the intraframe cor- 

20 relation is small, the image signals are orthogonal-transformed by the one-dimensional DCT without use of 
the two-dimensional DCT, thus increasing the transform efficiency and decreasing the transform noise. 

Further, in the practical apparatus, motion compensation is usually applied to the interframe prediction 
signals. However, the embodiment of the present invention including no motion compensation function is sub- 
stantially the same as the practical apparatus including the motion compensation function. 

25 Fig. 12 shows a second embodiment of the orthogonal transform decoding apparatus according to the 
present invention, in which the same reference numerals have been retained for the similar parts or sections 
which have the same functions as with the case of the first embodiment shown in Fig. 8. This deciding appa- 
ratus corresponds with the coding apparatus shown in Fig . 11. The functions of the variable length decoder 
22, the inverse quantizer 23, the vertical inverse DCT 24, the horizontal inverse DCT 25, and the selector 27 

30 are the same as with the case of the decoding apparatus shown in Fig. 8, and the functions of the frame mem- 
ory 420 and the adder 430 are the same as with the case of the coding apparatus shown in Fig. 1 1 . 

In the above-mentioned orthogonal transform coding apparatuses, since the dimension of the orthogonal 
transform is changed block by block to select the optimum transform method, it is possible to code the image 
signals for each block locally under the optimum conditions and thus to improve the coding efficiency all over 

35 the image, as compared with the coding method using only a fixed transform method. When the concept of 
the present invention is applied to the interframe prediction error signals in particular, since the interframe cor- 
relation of the prediction error is small, it is possible to execute the orthogonal transform coding at an extremely 
high efficiency. Further, since the one-dimensional orthogonal transform coding is adopted at the image edge 
portions, the noise caused by the quantization can be reduced, so that the image quality can be further im- 

40 proved by reducing the coding error. 

Further, in the above-mentioned embodiments, although two-dimensional and horizontal orthogonal 
transform coding and decoding apparatuses have been explained by way of example, it is possible to apply 
the present invention to various orthogonal transform coding and decoding apparatuses such as the two-di- 
mensional and vertical transform coding apparatus, vertical and horizontal transform coding apparatus, two- 

45 dimensional and vertical and horizontal one-dimensional transform coding apparatus, and further the coding 
apparatus having mode excluding the orthogonal transform coding. 



Claims 

50 

1. An image signal coding apparatus comprising: 

means for orthogonal-transforming image signals to be coded in different dimensions to obtain 
transform coefficients for each mutually different transform dimension; 

means for detecting a status of the image signals in a predetermined dimension; 
55 means for selecting the transform coefficients of one of the transform dimensions on the basis of 

the detected result; 

means for quantizing the selected transform coefficients; and 
means for coding the quantized signals to output the coded signals. 
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2. The image signal coding apparatus of claim 1, wherein said detecting means comprises means for de- 
tecting an activity of the image signals for each dimension, and means comparing the detected activities 
mutually. 

5 3. The image signal coding apparatus of claim 2, wherein said comparing means further comprises means 
for applying a weight to each transform coefficient according to frequency for each dimension, and said 
detecting means detects the activity of the image signals on the basis of the weighted transform coeffi- 
cients. 



w 



15 



20 



The image signal coding apparatus of claim 1, wherein said detecting means comprises: 

means for detecting a change rate of the image signals in the predetermined dimension; 
means for detecting an activity of the image signals; and 

means for detecting the status of the image signals on the basis of comparison between the de- 
tected change rate and the detected activity. 

An image signal coding apparatus comprising: 

means for forming prediction error signals by subtracting prediction signals from image signals to 
be coded, respectively; 

means for orthogonal-transforming the prediction error signals in mutually different dimensions to 
obtain transform coefficients for each different transform dimension; 

means for detecting a status of the prediction error signals in a predetermined dimension; 
means for selecting the transform coefficients of one of the dimensions on the basis of the detected 

result; 

means for quantizing the selected transform coefficients; and 
means for coding the quantized signals to output the coded signals. 

25 

6. The image signal coding apparatus of claim 5, wherein said detecting means comprises: 

means for detecting a change rate of the prediction error signals in the predetermined dimension; 
means for detecting an activity of the prediction error signals; and 

means for detecting the status of the prediction error signals on the basis of comparison between 
30 the detected change rate and the detected activity. 

7. The image coding apparatus of claim 5, wherein said forming means comprises: 

means for inversely quantizing a quantized output of first image signals inputted a predetermined 
time before the image signals to be coded are inputted; 
35 means for inversely orthogonal-transforming the output of said inversely quantizing means in a pre- 

determined dimension; 

means for selecting any one of the outputs of said inversely quantizing means and said inversely 
orthogonal-transforming means; 

means for inversely orthogonal-transforming the selected output in a dimension different from the 
40 predetermined dimension, to decode the prediction error signals of the first image signals; and 

means for forming the prediction signals by adding second image signals inputted a predetermined 
time before the first image signals are inputted, to the decoded prediction error signals, respectively. 

8. An image signal coding apparatus comprising: 

45 means for orthogonal-transforming image signals in mutually different dimensions to obtain trans- 

form coefficients for each different transform dimension; 

means for quantizing the transformed coefficients for each dimension; 
means for comparing the quantized signals for each dimension; 

means for selecting the quantized signals of one of the transform dimensions on the basis of the 
so compared result; and 0 

means for coding the selected quantized signals to output the coded signals. 

9. The image coding apparatus of claim 8, wherein said comparing means comprises means for detecting 
an activity of the image signals for each quantized output, to compare the detected activities mutually. 

55 

10. An image coding apparatus comprising: 

means for orthogonal-transforming image signals to be coded in mutually different dimensions to 
obtain transform coefficients for each different transform dimension; 
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means for quantizing the transformed coefficients for each dimension; 

means for coding the quantized signals for each dimension; 
means for comparing a coded quantity of the coded signals for each dimension; and 

means for selecting the coded signals of one of the transform dimensions on the basis of the com- 
pared result. 

11. An image signal decoding apparatus for decoding coded image signals obtained by orthogonal-transform- 
ing image signals in mutually different dimensions, selecting transformed coefficients of one dimension 
from the transformed coefficients obtained in the different dimensions according to a status of the image 
signals in a predetermined dimension, quantizing the selected transformed coefficients, coding the quan- 
tized signals, the coded image signals being transmitted together with mode information indicating which 
dimension the selected coefficients have been transformed in, which comprises: 

means for decoding the coded signals; 

means for inversely quantizing the decoded signals; and 

means for inversely orthogonal-transforming the inversely quantized signals in the dimension in- 
dicated by the mode information to obtain reproduced image signals. 

12. An image signal decoding apparatus for decoding coded image signals obtained by orthogonal-transform- 
ing prediction error signals obtained by predictive coding in mutually different dimensions, selecting trans- 
formed coefficients of one dimension from the transformed coefficients obtained in the different dimen- 
sions according to a status of the prediction error signals, quantizing the selected transformed coeffi- 
cients, coding the quantized signals, the coded image signals being transmitted together with mode in- 
formation indicating which dimension the selected coefficients have been transformed in, which compris- 
es: 

means for decoding the coded signals; 

means for inversely quantizing the decoded signals; 

means for inversely orthogonal-transforming the inversely quantized signals in the dimension in- 
dicated by the mode information to obtain reproduced prediction error signals; and 

means for reproducing the image signals by adding already-reproduced image signals to the re- 
produced prediction error signals, respectively. 

13. A method of coding image signals, comprising the steps of: 

orthogonal-transforming image signals to be coded in different dimensions to obtain transform 
coefficients for each mutually different transform dimension; 

detecting a status of the image signals in a predetermined dimension; 

selecting the transform coefficients of one of the transform dimensions on the basis of the detected 

result; 

quantizing the selected transform coefficients; and 
coding the quantized signals to output the coded signals. 

14. A method of coding image signals, comprising the steps of: 

forming prediction error signals by subtracting prediction signals from image signals to be coded, 
respectively; 

orthogonal-transforming the prediction error signals in mutually different dimensions to obtain 
transform coefficients for each different transform dimension; 

detecting a status of the prediction error signals in a predetermined dimension; 

selecting the transform coefficients of one of the dimensions on the basis of the detected result; 

quantizing the selected transform coefficients; and 

coding the quantized signals to output the coded signals. 

15. A method of coding image signals, comprising the steps of: 

orthogonal-transforming image signals to be coded in mutually different dimensions to obtain trans- 
form coefficients for each different transform dimension; 

quantizing the transformed coefficients for each dimension; 

coding the quantized signals for each dimension; 

comparing coded quantity of coded signals for each dimension; and 

selecting the coded signals of one of the transform dimensions on the basis of the compared result. 

16. Amethod of decoding coded image signals obtained by orthogonal-transforming image signals in mutually 
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different dimensions, selecting the transformed coefficients of one dimension from the transformed coef- 
ficients obtained in the different dimensions according to status of the image signals in a predetermined 
dimension, quantizing the selected transformed coefficients, coding the quantized signals, the coded im- 
age signals being transmitted together with mode information indicating which dimension the selected 
coefficients have been transformed in, which comprises the steps of: 

decoding the coded signals; 

inversely quantizing the decoded signals; and 

inversely orthogonal-transforming the inversely quantized signals in the dimension indicated by 
the mode information to obtain reproduced image signals. 

17. Amethod of decoding coded image signals obtained by orthogonal-transforming prediction error signals 
obtained by predictive coding in mutually different dimensions, selecting the transformed coefficients of 
one dimension from the transformed coefficients obtained in the different dimensions according to status 
of the prediction errorsignals, quantizing the selected transformed coefficients, coding the quantized sig- 
nals, the coded image signals being transmitted together with mode information indicating which dimen- 
sion the selected coefficients have been transformed in, which comprises the steps of: 

decoding coded signals; 

inversely quantizing the decoded signals; 

inversely orthogonal-transforming the inversely quantized signals in the dimension indicated by 
the mode information to obtain reproduced prediction error signals; and 

reproducing the image signals by adding already-reproduced image signals to the reproduced pre- 
diction errorsignals, respectively. 
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